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1.  Summary  and  Introduction. 


•  • 


Exact  distribution-theoretic  results  in  the  field  of  multivariate  analysis 


are  too  often  unknown.  In  order  to  make  specific  numerical  probabilistic  state¬ 


ments,  one  often  must  resort  to  the  use  of  approximations  or  electronic 
computers  or  both. 

In  a  number  of  situations  the  use  of  bounds  provided  by  multivariate  Chebysher 
type  inequalities  may  be  more  appropriate.  These  bounds  have  the  advantage  of 
being  distribution  free  and  may  be  applied  even  if  unknowns  preclude  the 
legitimate  application  of  distribution  theory. 


In  this  paper,  inequalities  Involving  the  minimum  component  and  the 
product  of  components  of  a  random  vector  are  investigated.  If  we  are  interested 


L  ‘ 


in  whether  all  of  k  variances  exceed  some  preassigned  value,  or  in 
estimating  the  reliability  of  a  system  of  k  components  whose  performance 
critically  depends  on  the  smallest  value  obtained  by  some  characteristic 
of  the  components,  then  the  former  kind  of  inequality  may  be  useful.  The 
second  kind  of  inequality  may  be  also  useful  in  reliability,  which  is  some¬ 


times  measured  by  the  probability  that  a  product  of  indicator  variables 
exceeds  a  critical  value.  Another  area  of  application  for  the  second  kind 
of  inequality  arises  from  the  fact  that  the  likelihood  ratio  statistic  for 
testing  cirtain  hypotheset  (  e.g.  ,  independence  of  sets  of  variates)  in 
multivariate  analysis  is  a  product  of  variables  and  its  distribution  is 
known  only  in  a  very  lew  cases. 


L  •  .  • 
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If  X  is  a  random  vtriaiiLe  with  DC2  -  a2  ,  then  by  Chobyshev's 
inequality. 


(1.1) 


PfiXi  >  £j  <  ct2/£2 


If  in  addition  EX  =  0  ,  one  obtains  a  corresponding  one-sided  inequality 


(1-2) 


PfX  >  c)  <  a2/(e2+  a2) 


(see,  e.g.,  (8]  p.  198).  In  each  case  a  distribution  for  X  is  known  that 

results  In  equality,  so  that  the  bounds  are  sharp.  5ote  that  &  change  of 

variable  permits  the  choice  cf  €  to  be  unity  with  no  loss  In  generality. 

There  are  many  possible  multivariate  extensions  of  (l.l)  .and  (l.2). 

Those  providing  bounds  for  F{  max  ‘X  j  >  1)  and  Pf  max  X  >  1} 

1  <  J  <  k  ’  J  1 <  J  <  k  ^  ~ 


\ 


have  been  investigated  in  [3>5>9l  and  [4],  respectively,  We  consider  here 

cc  r  *-<Al  I  £ 

jrarious  ir.equalitles^involving  (^)  the  minimum  component  or  (^)  the 


product  of  components  of  a  random  vector.  Derivations  and  proofs  of  sharpness 
3- 


for  these  two-  classes  of  inequalities  show  remarkable  similarities.  Some  of 
each  type  occur  as  special  cases  cf  a  gener^il  theorem. tn-fieeticr.  3- 


Bour.ds  are  given  und<r  various  assumptions  conceding  variances, 
ccvarlantes  raid  independence. 


Rotation.  We  denote  the  vector  (l,...,l)  by  e  and  (C,...,0)  by  0  ; 


the  dimensionality  will  be  clear  from  the  context.  If  '  x  =  (x^, ...» 

RDd  J"  (y^---^)  »  we  write  x  >  y  (x  >  y)  to  mean  >  y^  (x^  >  y^)  , 


l,2,...,k  .  If  Z  -  (o.  )  :  k  x  k  is  a  ^caeat  matrix,  fcr  convenience 


we  write  a,.  -  o',  , 
*j  J  J 
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Unless  otherwise  'Stated,  w«  assume  that  £  is  positive  definite. 


•  .  • 


2.  On  Proving  Sharpness . 

In  can/  cases  ChebyshfeV  type  inequalities  can  be  proved  by  defining 
a  non-negative  function  f  on  R  (k-dlmensional  Euclidean  space)  such 
that  f  (x)  >1  for  all  x  i  T  c  Rk  .  Then  if  X  is  a  k-dimensional 
random  vector. 


l..  •  ».  ...•' 


t  • 


(2.1)  Ef(X)  =  /  f(X)dP  +  /  f(x)dP>  /  f(x)dP  >  P[X  €  T] 

fX  c  T)  (X  /  T]  ~  (X  €  T) 


V-  -1““^ 


The  bound  of  (2-l)  depends  on  the  distribution  of  X  .  Ordinarily,  one 
stateB  the  inequality  with  flOme  further  hypotheses  Jf  ,  e.g.,  EX’X  =  £  , 
in  order  to  obtain  a  more  explicit  determination  of  the  bound  Ef(x)  . 

We  call  such  an  inequality  sharp,  if  for  every  c  >  0  and  every 
value  of  Ef(Z)  possible  under  3/  there  exists  a  random  vector  Z 
satisfying  3(  ,  with 
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P{Z  c  T)  >  Ef (Z)  -  €  , 


in  which  case  no  bettor  bound  can  bo  given  without  stronger  hypotheses. 

Except  in  Section  6,  the  sharpness  c>f  (2.l)  will  follow  as  a 
consequence  of  the  stronger  result  that  there  exists  a  random  vector 
(sa. isfylng  H)  for  which  equality  is  attained. 
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If  one  is  tc  prcve  '2.1;  sharp  by  exhibiting  a  distribution  for  1 
attaining  <  quality,  then  that  distribution  nust  assign  probability  only 
to.  points  x  c  I  for  which  f(x)  =  1  and  to  points  x  /  T  for  which 
f(x)  =  0.  Ht-nce,  to  obtain  a  cistrioution  for  X  achieving  equality 
in  (2.1),  we  begin  by  ccnsia-  ring  distributions  that  assign  probability 
only  tc  the  rows  of  a  aatrix  j  with 


(2.2) 


•.  0  ,  .  1  , 


.<»  „ 


i  =  1, — ,m  ;  J  =  l,...,s  , 

,(j) 


where  c  is  the  i-th  row  of  C:  a  X  k  and  wVj/  is  the  J-th  row  of 

‘(i) 


W:  n  x  k  .  Since  f(x)  >1  for  x  €  T  ,  (2.2)  lcplie3  cl  ;  /  T  for  all 
i  ,  but  we  still  must  specify  that 


(2-3) 


(J) 


€  T  for  all  J  . 


Conditions  (2.2)  and  (2.3)  =8/  be  sufficient  tc  define  bcth  C  and  W 
(e.g.,  see  [4,5]).  However,  if  f  is  a  quadratic  fora  that  ia  n&t  positive 
definite  but  or.ly  positive  seal -definite,  then  [x:  f(x)  -  0)  is  not 
finite  and  (2.2)  will  not  define  C  .  In  this  paper  roost  proofs  of  sharpness 


arc  complicated  by  the  fact  that  positive  seal -definite  functions  are  used. 


If  Pfc^1')  -  p  ,  I  =  1,2,..., a  ard  P(w^)  =  q4  ,  J  =  1,2,-. .,n 


then  attainment  of  equality  in  (2.l)  means  that 


(2.4) 


Z  =  q  =  Ef(x)  ,  Z  p,  -  1-q 
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Let.  D  -  doag(p,,..  .,p  )  ar.d  D  --  diag(q  ,...,a  )  . 

p  id  1  U 

Most  inequalities,  considered  in  this  paper  tve  stated  with  the  hypotheses 
£  X'X  -  £  and  sometimes  also  with  E  X  =  0  .  The  condition  EX  •-  0  Is 
equivalent  to 


e  D  C  ■*  e  D  V  =  0  , 

■  p  q 


•  • 


and  the  condition  E  X'X  £  is  equivalent  to 


■  C'  0  C  +  V  D  W  -  £ 

P  q 


One  can  tpy  to  solve  equations  (2.5)  and  (2.6)  (or  equation  (2.6) 

alone  when  EX  0  is  not  a  hypothesis  tor  (2-.l))  subject  to  conditions 

(2.*0  with  jhe  realization  that  {2-2)  and  (2.3)  must  be  satisfied.  These 

requirements  may  not  be  sufficient  to  define  the  various  parameters,  in 

which  case  the  example  attaining  equality  is  not  unique. 

.  If  T  is  symmetric  about  the  origin,  it  may  be  convenient  to  replace 

C,  W,.  D  and  D  by 
p  q 
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respectively,  in  which  cas^  (2.5)  is  automatically  satisfied  and  (2.6)  is 
unchanged. 
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3.  Sounds  Involving  Convex  Sett. 

If  v.  wish  the  bound  Ef(X)  to  be  in  terra  of  the  first  and  second 
moments,  then  f(x)  must  be  quadratic,  possibly  with  linear  terms,  i.e., 
f  (x)  v  (x-a)  A(x-a;  *  .  A  bound  is  then  obtained  by  niniaising  Sf(x) 
subject  to  the  conditions  f(x)  >  0  ,  f(x)  >  1  for  xcS.  If  the 
complement  of  T  is  bounded  then  clearly  these  are  satisfied  only  for 
positive  definite  A  .  However,  if  T  is  either  convex  or  the  union  of 
two  convex  sets,  a  minimizing  A  cannot  be  positive  definite.  For  if  A 
is  positive  definite,  then  by  (2-2)  C  *•  0:  1  X  k  .  Furthermore, 

[x:  f(x)  <  1}  is  st-ictly  convex  (an  ellipsoid)  so  [f(xi  ®  1)0  T  has 
at  most  two  points  and  V:  1  X  k  or  2Xk.  However,  a  three  point 
distribution  Is  not  in  general  sufficient  to  fulfill  all  the  conditions 
EX'X  •=  Z  . 

The- following  theorem  gives  conditions  when  a  ministries  A  has 
rank  1  (in  which  case  A  has  a  representation  A  =  a*a  ,  a;  1  X  k)  and 
the  above  procedure  leads  to  sharp  inequalities. 


3.1.  A  General  Theorem- 

Theorem  3.1.  Let  X  *  (X^, . . be  a  random  vector  with  EX  =»  0  , 
EX ’X  ->  E  .  Let  T*T+(J  {x:  -  x  «  T^)  ,  where  T+  C3*  is  a  closed, 
convex  set. 

(1)  If 


(3-1) 


Q=  (a  €  R*:  ax’  >  1  for  all  x  €  T  } 
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for-  all  8  e  S  ,  t  c  T+  .  Since  0  «  S  ,  v>0  .  In  accordance  with 
the  remark  following  the  theorem,  we  assume  0  ^  T+.  Then  If  v  =  0  , 

0  >  st^  for  all  t  c  S  Implies  t^  *  0  ,  a  contradiction,  so  v  >  0. 
Clearly  a  £  r ’  *  1  . 

We  first  si  >w  that  t.  =  v  s  £  .  Let  s*  =  t  £’Vb  ,  whore  b  >  0 
O  o  o 

Is  chosen  so  that  a*  £  s*’  »  1  .  By  Cauchy's  inequality, 


••  I 
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(3*5) 


(s'  Z  s’)2  <  (s*  T.  8^'/(s3  Z  a^)  -  1  -  . 


But 


(3*6) 


'a  s*  2  s'  «  s  t'  -  v  >  s*t'  =  *b  s*  21  s**  =  b  , 
ooo—o 


so  that  s*  £  s^  >  1  .  Hence  equality  holds  In  (3*5)  and  3*=  a  sq  f 


where  a  is  a  scalar-  Since  1  =  a*  Z  s**  ^  d2  s  is’  ^Ct2fa-c  +  l 


and  3  ■*  *_  s*  ,  and  "by  (3-6)  b  -  v.  But  b>0,v>0,  so  that 


a  =■  8*  .•  Eencc,  t  =  v  s  Z  . 
o  o  o 


Note  that  t  has  squared  norm 
o 


I?  «' 


s' 


t  f  =  V2  V-?-- 
O  O  S  Z  B 


.  2  _2 
<  V  P  , 


where  P  i3  tne  maximum  characteristic  root  of  Z  .  If  wc  replace  7 


by  some  larger  set,  then  the  value  of  the  gccne  cannot  be  increased  and 
the  beat  strategy  for  player  II  still  has  norm  leas  than  or  equal  to  vP  . 
From  this  it  follows  that  the  boundedness  assumption  on  7  may  be  re- 


moved. 
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Let  a  =  a  /v  ;  then  a  Z  »'  =  l/v  and  a  t’  =  s  t’/v  >  1 
OO  O  O  •  O  O'  — 


a 

whenever  t  e  T  ,  so  that  a  e  (£  .  Using  Cauchy’s  inequality,  t  E'-1"  t*  - 

o  o  o 


v  and  a  t *  >  1  ,  we  obtain 
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■2{a  £  a’)  -  (tc  T"1  t*}(*  £  a')  >  (a  t^)2  >  1 


Hence,  a  Z  a*  >  i/v  =  a  £  a*  -  Thus  {3. St)  is  satisfied;  furthermore 
-  —  00 

v  *-■  t  =  v  s  £  ---  a  £/q  €  T  .  jj 

Proof  of  ^11;.  For  convenience  the  subscripts  on  qQ  «  q(aQ),  q*  -•  q*(aQ), 

and  w  -  w(a  )  will  be  emitted, 

o  .0 

We  first  prove  that  (3-2)  is  sharp.  Chocse  r  >  k  and  let  M:  r  X  k 
be  such  that 


Choose  D  =*  diagfp^,.  ,.,pr)  ,  such  that  p^  >  0  ,  £  Pi  =  1-q  ,  and  define 

-I/2 

C  3  D  K  .  Consider  a  random  vector  Z  with 

P(Z  -  c«4>)  =  P(Z  =  -  c&>)  =  Px/2  ,  i  -  l,...,r  , 

P[Z  a  w)  ■■=  P(Z  *  -  w)  «  q/2  , 


where  c*  is  the  1-th  row  of  C  .  Then 


EZ  a  0  ,  EZ'Z  a  C’  DC  +  q  w'w  a  Z 


(2.2),  .W  /ST  if  aC'-O.  But  this  holds  since  aw'  =  1 


C’-  DCs'  =  a(Z  -  q  w’w)*'  *  0  . 


f  .k.W--;.*-'-  v  ++a*Jta \wfxsecrxsvt  m 


♦  •  •  -  • .  •  -  M  « 

■  '•  \  *•  *<1  „ 

'  »* .**  :»• 


*  ASTST- 


By  Lemma  3.3,  w  el.  Erne.-,  P(Z  e  T j  --  1  and  equality  in  (3.2)  i« 


attaint'd  whenever  F{>  =-  Z)  =  1 


We  next  prove  that  (3-3)  is  sharp.  By  Lemma  3.2,  there  exists  a 


non-singular  matrix  M‘  k  >:  k  such  that 


•M'H  --  Z  -  c*  v'w  . 


Choose  an  orthogonal  matrix  r :  k  X  k  which  rotates  -  q*  w  M"1  to  the 


positive  orttant,  i.e.,  -  q*  w  M-1  1*  >  0  .  Define  D  -  dlag(p1,...,pi) 


and  C  by 


<:  D1/2  =  (v'pj\...,/p£)  = 


c  =  r’K  d”1/2  . 


Consider  a  ranacn  vector.  Z  with 


F{Z  r-  cv  ')  =  pt  ,  i  =  l,...,k  ,  P{Z  =  w)  =  q*  , 


where  cv  is  the  i-th  row  of  C  .  The 


EZ  3  oDC  +  wq4*  •-  (  -  q*  w  M*1  r)(r*  M)  +  wq*  «  0  , 


EZ'Z  =  C'DC  ■*  q*  w'w  H’M  +  q*  v’w  -r  Z 


Ut  ns  verity  that  Z  Pj  =  1  -  q*  =  l/(lvq)  .  Noting  that  w  Z_1  w’  l/q. 


,**  <*'*\**>»  i"*  w*'  **"■»  . 
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By  L.'mma  3-2,  w  «  *  Since  (a  C'  t  eq)  D(C  a'  t  qe ' )  =  0  , 

/.  % 

aC‘  »  -  <>q  ,  ana  c‘*  i  T  .  Hence,  F(Z  €  1  3  =  q*  ,  and  equality 

4*  4* 

In  (3-2)  Is  attained  whenever  PfX  r  Zj  »  1  .  |j 


Remark.  Suppose  T  is  not.  convex.  Trie  following  example  Bhovs  that 

(il)  need  no  longer  be  true  even  when  CL  is  non-empty. 

let  k  =  2  ,  T  {x:  x  >  0  ,  x?  +  £  >  1)  ,  and  let  T  -  7  U  (x:  -  x  €  T  } 

P{X  €  T)  <  tr^  *  Og  follows  fro®  (2.1)  with  f(x)  =  x^  +  x|  .  Now  ax’  >1 

2  P 

on  T+  If  and  only  If  >  1  ,  a^  >  1  .  But  a  E  a'  >  cr^  *  vhenever 
ff12>0  8,1(1  8^1  »  »2  >  1  - 

3-2.  Bounds  Involving  the  Minimum  Components. 

Theorem  3.U.  If  X  -  (X^, ...jX^)  is  a  random  vector  with  EX  =  0 
and  EX'X  =  E  (E  positive  definite)  ,  then 


(3-7) 


P(  min  *<>1  or 
1  <  J  <  k  J  " 


min  (-  X  J  >  1)  < 
1  <  J  <  k  J 


mir.  - : -  . 

s  c  E*1  e  * 
s 


(3-8) 


Pf  min  X  >  1)  <  min  - - -  , 

1  <  J  <  k  J  “  “  s  1  +  e  E”^  e' 


where  the  minimum  is  taken  over  all  principal  submatrlces  E  of  E 

8 

such  that  o  >  0  . 

8 
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rrcol'.  Let  i  -  %X  t - .  }  d>  such  that  D"X'~  Z  .  Consider  tlwi 

a  s  8 

.  function 


/  *.'2 

('=  2  *  i 

ff»V.  - 2-, - 

{—-X  .  a  \4i 
t-  *-  f  ; 

s 


Clearly  l’(x‘  >  0  fer  all  x  and  f(x)  >  1  for  x  €  T  •-  (  min  x  >  1 

*  «J  * 

or  min  (-x  )  >1}  .  Since-  £f(x)  =  l/(e  Z"1  e**  ,  we  obtain  (3.7) 


j  fron  ^2.1)  .  7 


fron  (2-1)  .  ?e  obtain  (3.8)..  replace  f(x)  by  (e  Z*1  x*  4  l)2/  (c  Z-1  e*  t  1)* 

s  s 

and  T  by  [  cin  x,  >  1}  in  the  above  proof,  jj. 


There  always  exist  principal  eut> matrices  Z^  cf  Z  such  that 
<?  >  0  ;c--g.f  if  Zs  is  1  X  1)  so  that  (3-7/  and  (3.8)  always  provide 

a  bound. 

Theorem  3-!>-  Equality  an  (3-7)  and  (3-8)  can  bo  attained  whenever 
the  bound  is  less  than  one. 

Proof.  The  function  f(x)  of  (3.9)  i3  of  the  fore:  (ax’)2  •  In  order  to 
apply  Theorem  3.1  we  nest  shew  that  the  bound  (3.7)  is  obtained  by  mini- 
raizing  q  -  a  Z  a'  =  E(a  X')  subject- to  the  restriction  that  n  e  Q. . 

Here  T  -  f  min  x  >  l)  and  d  -  fa-:  ax'  >  1  for  x  e  T  )  - 

4  J  J  “ 

fa:  a  >  0  ,  ae'>  l}.  By  Cauchy's  inequality 


i  h- 

i  r  •/ 


•  .  _  • 


i  /  \*  *,* 

v  . 

«'  *  •  v  *  ',-  ***  „•»  »*■  .  - 


•«t 1  ,  i 


Z  a*  >  (a -a')2/  (c  Z*1  e«)  , 


and  min  a  Z  a1  =  min  a  Z  a’  =  l,/(c  Z*1  o’)  occurs  at  a  -=  c  Z-1/  (e  Z*1  c')  . 
d  ae1  =  1 


•  J  „• 


*•  .*■ 

,  '  v*  . 


•  •  • 
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Ixagpic .  I.  If  k  «  2  *  <  °2  » 


Bit 

S 


e  3L'1  e* 
s 


1T  °l  —  °J2  * 


35  ex  > 


2  2  2 
C1  °2  ~  ff12 
2  2  * 

C1  *  °2  ‘  2ff12 


JExasple  2.  If  E  =•  cr^ i  *l-c  •  I  ♦  P  e  V'  ,  i  .e.,  o.,  -  e  ,  - 

a2 p  x"i  /  j)  j  then  e  I-1  >  0  ar.i  e  I*''  f‘  ■  -  (H)p)]  - 

Proof.  £**  -  (I  -  <s  <  1-*>)1  ,  vh*re  ti  •=  pjl  -4  . 

Sirce  the  coluca  subs  of  E  ^  arv  all  e^ual,  and  e  E  ^  *-1  >  0  , 
it  fellows  that  el‘">0  .  Ihf  rcspctaticn  of  e  E~^  e:  is  inwediate-  $ 

Pxaaplf*  3.  Let  X  =  b(u  -  r’p)  >  where  3  -*  diag'p, . p„ )  ,  p  •-• 

k  A  * 

(p , .  ,.,p  )  ,  £  <  1  .  It  is  easily  verified  that  X  *  -  (D-1  ■»  e  e 

•t  k  ^  -  o 

tl^>0  and 


1-ep 


i'1  e*  ,  i  l  X  ^ 
D  1  ri 


(fc-ir  , 

k  ; 
i-ip. 


k-1 


If  the  ranao;;  -ectcr  1  =  \X 
ccsial  distrl  butler. 


,)  ,  £  X,  --  e  ,  has  a  multl- 

1 


1*  *'-W  -  7  "l 

•iiaete-rs  Pj_* ’*••1^4^  »  -*ve  cciririaace  matrix 
cf  X  13  singular,  but  the  ccvariance  sstrix  cf  (X.  is  £  . 


Exaspic  k.  A  special  ftr*  cf  Green  s  aitrix  A  ■  (a  >  ,  a^  =  a  -  u  v 

ij  -J  ji  i  j 

(l  <  j)  Is  given  by 


••'W^'S  fc  «“i>  ; 


e  I  >  0  ,  ar.d  exaagj.es  c*a  be  obtained  where  varicu*  subaanrieea  II 


lead  to  the  best  bound.  Hcv.ver,  If  £  -  0  In  Pxaaple  2  cr  <J^  =  0  In 


#  p  "?  .1  i 

Example  i,  then  £  -  diag'cr^,. .  .,o£)  sc  that  c  £  >  0  ar4  e  £  e* 


Exagiple  Lot  Y  ,  Y_, be  ur.corrvJLe.sed  randos  variables  with 
1  2  K  *  *  *  i 

£Y  =  0  ,  FC  =  t .  >  J  =  1,2, ..-,k  ,.  and  suppose  that  X  -  £  Y  . 

J  J  J  *  ^  J 

i  -  1,2,.. ,  are  partial  sums-  Then  U4  -0,1^  1,2,  —  ,  and 


£x?x  =r  £  ^ 


where  at  -  I  t  ,  5c  that  a,  <  <  .  • .  <  a. 

*  ^  J  1—2—  —  X 


In  this  case,  e  £  >0 


only  for  £  ;  1  X  1*,  and  mtn  l/(e  £  ^  e*)  •«  * 

s  _  •  1 


Proof:  If  T  is  the  upper  triangular  ratrix 


\  T1  *** 


\\\>  V  v>  *  ■*  - 


•  - 

* *,.%\vCv] 


• 'W-'.v.v 

.Vas/vV*V; 
-- * -  .  v- 


V-  .11 


•  • 


V-V-' 


•  .  • 


•  • 


:::v:v::l 


•V-V  V-! 


•  • 


'  %  .  'I  • 


v \  *  ,  -  ,  **v,w 


thr  i  £  IT’  .  5:no  I  *  has  main  diagonal  {  —  •  —  > - •  - »  )  ,  super 

.  T1  ‘2  Tk  ^ 

diap.rral  * — —  ,  -  —  ,  -  -  , - 5  ar.i  all  ether  «ntries  zero  ,  e  I  * 

'*2  X3  ’k 


ft”1  ,  0,  ...,0V  ,  and  >  £-^  •  (t”^  ,  0,...,0)  .  All  principal 

X  1 


submatrlces 


ci  1  nr*  <•!  the  sa-re  Jc'c  as  £ 


,  so  that  «•  £~  >0  c.r.ly  when  £  is 

S  4 


1  •<  1  .  Thus  m:r. 


1  2  „ 
-*-3- —  •••  ffi  -  k 
e  £  1  e’ 
s 


3-3  3cur.-_s  frr  the  rrcduct  of  random  va:  fables. 


Th.  c.-.  s  3  6.  II  >:  i  (X, ,  - . *  is  a  random  vector  with  EX  a  0 
- »—  1  k 


and  EX  'X  -•  £  ,  then 


(3-10)  •  Pf ;7TX .!  >  1  ar.d  X>0  cr  X  <  0)  <  min  a  £  a'  , 

J  “  .  cf) 


(3-H> 


P(  jTrx.l  >  1,  X  >  0}  <  min  r-*-f-TTT  > 

j  -  a  €£t  a  **  a 


wh i'O  Q  is  given  ij  (3-1) - 


Ihc-e  is  a  unique  solution  a”  of 


(3-12) 


a  Z  -  4^  £  ’ 


1  1  1  ^ 

(-)-■  (—  — )  ,  with  a*"  >  0  andTTa*  -  k  .  Furthermore, 

a  al  \ 

rain  a  £  a’  =•  a*  £  a*1  . 
a  f.  Q. 

Proof,  rnoqualltles  (3-10)  aac  (3-11)  fellow  from  Theorem  3.1. 

To  p-ove  the  second  part  of  the  theorem,  we  begin  by  showing  that 


•  • 


; #v jv s 

•  •- 


.  f 


<  '_**  * " 

^  •  — 

L  • 


•  •• 


•  «*•  "  ).  -  *  * 


•  • 


a,  ■■  {a:  a  >  0,  TT  a,  >>"kj  when  d  i»  6lv«n  b*  v3-l)  *lth  T* 

UTTx  I  >  1  ,  x  >  0).  If  a  cQ,  >7T  x*  >  1  ard  x  >  0  i  thea  ualE« 
J  “  . 


Za  x^/k  >TT  7  we  obtain 


ax  ■  >  «*/(7T»J!1/k  £  kTT«j1/k  >  1  . 


.r.c  a,c  Q  ■  If-  a  c  Q  then  a  >  0  ;  for  if  a^  <  0  »TTxj  >  ^  1111,1 


x  >  0  ,  then  cr.e  car.  increase  x^  and  thereby  decrease  ax’  while 


]  preserving  JT  x  ,  >  1  •  Furthermore,  a  e  Q  implies  that  f]”  aj  -  k 

5  J  ~ 


For  if  we  suppose  the  contrary,  then  since  x  =  TT  aj  (j)  satisfies 

TT  l/k 

x  >  0,  Tf  X  >.  1,  we  obtain  the  contradiction  ax 1  =  k|T  *j  <  1  . 

J  ~~ 


Thus  QC  (3^  ,  and  vo  conclude  that  &  --  Q-^  - 

We  wish  tc  replace  Q.  by  a  bounded  set.  Denote  the  minimum  (maximum) 
characteristic  root  of  Z  by  Pn  (pjJ  ,  choose  q>  >  1  and  define 
p  -  q»  P|/  k-  PB  =  &(»  ^a:  aa’  <  p}  .  If  aa*  >  p  ,  then  since 


x*1  pb<  x  £  x*  <  xx'  PM  for  all  x  e  R  , 


(3-13)  P 


lEri|pM<0^  ±aZa’ 


But  e/k  e  Q  bo  that  inf  a  Z  a'  =  inf  a  Z  a'  . 

Ol  0.*  ( 

Since  Q.*  is  compact,  there  exists  a*  e  Q.*  for  which  ijjf  a  Z  a 
a*  E  a*  .  By  considering  multiples  of  a*  ,  one  obtains  *JT  aj  1  1 

The  above  arguments  show  that  the  problem  reduces  to  that  of  finding 
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.*■  w*"  «<V 

’  -  -  «*- J.  V 
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*  -  "  •  -  t  * /  *-•*■*■  '«  '  «  •  > 

•  •  .  *  .  »  .*«*.*'.“.* 

V  *,«  v  *t.  *m 


Inf  a  £  a'  subject  to  the  condition  fT  a.  '£-  k  •  This  , 

a  >  0  ,  aa*  <  p  * 

inf  imum  ones  net  occur  cr-  the  boundary  of  £a  >  0  ,  aa'  <  ,  because 

__  -k 

the  ?onditlcn  TT  a  -  k  does  net  allow  a,  -  0  ,  and  strict  in- 
J  J 

equality  in  (3 - 13 ) dees  not  allow  aa*  -  p  -  Thus  we  conclude  via 
Lagrange’s  multiplier  that 


L  ..  • .  _  t 


t  *  v  “  ?  *  ,*  “  "  _  ““<*** 

L  -  .  •  a 


l*/.*  *  * 


a  £  --  \  TT  aj  (i)  .  TT  ^  =  k-k 


^!be»ciia5s*« 


must  have  a  simultaneous  solution  a  such  that  a  >  0  ,  a  a*  <  p  . 

o  o  o  c 

Furthermore  the  desired  ralnimizer  a*  is  among  such  solutions.  Fost 
multiplication  of  the  first  equation  above  ty  a*  yields  X  = 
a  Z  a*/  (k  TT  a^)  ,  so  that  (3-12)  is  obtained. 

— jj 

Suppose  there  is  another  solution  u  of  (3-12)  with  TT u j  =  k  , 
u  >  0  j  then  u  Z  u*  >  a*  Z  a**  .  Post  multiplication  by  £”k(i)*  in 
(3-12)  yields 


l _ «... .  •  _ • 


OOV*-’  \“  * 


(b  r1  (hr  - 


Uslot  the  fact  that  the  geometric  mean  is  dominated  by  the  arithmetic 
me^.i  and  then  applying  Cauchy  *8  inequality  we  obtain 


a?  l/k  ,  ill 

=  X  TT  (-A)  <  (-)  a"'  <  tv~)  Z'1  (I)' 

'u,  —  'u  —  'u  'u 


a*  L  a**]1/2  =  [k2  Sl^1'1/2 
J  u  Z  u*  ' 


«  ,  •*,  «*,  •t>  .*i  «*t  ,*  \  " 

L _ • _ •  • 


_•  • 


*,■  •;  •;  •/  *  •  %•  »•  a *\ • . 
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v«'* 
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',V.  -  o  ■  *  • 


Hf-r.ce  we  have  r quality,  so  that  u  -  a*  -  *j' 

Cc -clla'y  3.7.  Equation  (3-12)  has  cnt  and  only  one  solution  in  each 

crthar.i  subject  tc  J~ffa  |  “  c  >  0.- 

J 

Proof.  Or.e  can  rcplac*  the  positive  orthant  in  the  arguments  of  Theorem 
3-6  by  any  ether  orthant,  and  so  conclude  that  (3*12)  has  a  unique  solution 
in  every  orthant.  j{ 

Theorem  3-8*  Equality  in  (3 .10)  and  (3.H)  can  be  attained  whenever  the 
bound  is  less  than  one. 

Proof.  This  is  a  special  case  of  (ii).  Theorem  3.I. 

Wc  consider  now  two  special  cases  for  which  the  bounds  can  be  given 
explicitly. 

Example  1.  If  k  -  2  ,  then 

(3 -l1*)  min  a  £  a'  =  (a.cr  ♦  ff,,,)/2  • 

a  12 

Proof.  In  this  case  the  direct  solution  of  (3*12)  together  with  a  >  0 
and  a^a2  ~  ^  2  yields  ---  \J Cg/^ ,  Sg  --  \J . 

Example  2.  If  the  column  sums  cf  E  arc  all-  equal,  then  min  a  £  a'  •_ 

—  a 

(e  £  <i')A2  •  I*"*  particular  if  £  --  ff2[(i-p)l  4  pe'e]  then  min  a  £  a*  - 

2  d 

a  [l-»(ic-l)p]/k  . 

Proof.  Equality  of  the  column  su»3  cf  £  means  that 
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Ve  now  consider  the  question  of  sharpness.  Suppose  that  <r^ 


o’.  -  c  ,  in  which  case  all  three  Inequalities  can  be  proved  by  (2.l) 

*  k 


with  f(x)  =  y  x.2/k  .  In  order  to  satisfy  (2.2),  CtL  X  k  must  be 
1  J 

the  zero  vector,  and  W:n  X  k  must  be  a  matrix  with  xuu  -  +  1  . 

aj  — 


Matrices  H  =  (h  ):m  X  m  with  h.  *  +  1  and  EH"  -  ml  are  called 


Hadamard  matrices.  Various  sufficient  conditions  for  ii&lr  existence  can 
be  found  In  {2,  6,  7lj  e-g they  exist  if  m  *  4(xr  +  where  x  is  an 
odd  prime,  r  fs  a  positive  integer.  A  necessary  condition  for  their 
existence  is  that  m  =  2  or  m  =  4t  for  some  positive  integer  t  .  If 
H  Is  a  Hadamard  matrix,  then  so  la  HD£  ,  where  D£  *  cfc*gC+  1,  ♦  l)  . 

Hence  we  can  assume  that  the  first  row  of  H  is  e  . 

Prom  [2.6)  and  the  fact  that  C  consists  of  the  seca>  vector  we  know 
that  the  attainment  of  equality  depends  on  the  solution  off  W'EW  =■  £  . 

Our  use  below  of  Hadamard  matrices  for  V  atens  from  the  fact  that  matrices 
£  of  a  certain  class  are  diagonalized  by  Hadamard  matrices  whose  first 
row  Is  e  . 


Theorem  4.2.  Let  £  =  a  [{l-p)l  +  pe'e]  . 

(l)  Equality  can  be  attained  in  (4.1)  and  (4.2)  if  a  Hadamard  matrix 
of  order  k  exists  or  if  P  >  0  . 

(ii)  Otherwise  equality  may  not  be  attainable. 

Proof  of  (l)  .  Because  of  the  form  of  £  ,  any  Hadamard  matrix  W  of 
order  k  will  diagonalize  £  ;  i.e.. 
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vhers  D.  =  diag'q^...,^/  =  drag  £[l-»  (k-l)p]  ,  (l-p), . <j2/ k  . 
The  characteristic  rrctE  cf  Z  arv  kq^  >  0  . 

Ccrstder  the  random  vector  2  with 

?{z  -  (0,— ,C}]  =  l-er2  , 

F  {Z  =  Ji})  =  =  (Z  -  -  w(l)  j  -  qt  /2  ,  i.l,  2,  k  , 


vhere  vv  '  is  the  1  rev  cf  V  .  Clearly  Z  =  a ,  ZZ'Z  =  Z  , 
ar.d  w<-  c  T  when  T  »  /lit  ja^j  >  lj  or  £|  Tf  Xj)  >  lj  . 

P 

If  P  >  0  ,  let  I*  =  c  [(l-p)l  +  pe’e]:m  X  a  where  a  >  k  is  such 
that  a  Ssdanard  matrix  cf  crier  c  exists.  Z*  is  a  positive  definite  and 


=  p/  min  iZ  \  >  if  <pf  min  \Z  •  >  ll  < 
U<J<x  J  J  ll  <  J  <  k  J  J 
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where  the  distribution  cf  Z  =  (Z^, ...»  Z^)  is  given  as  in  (i-5)-  !! 

Froof  cf  (it).  By  ^min  I,|  >  lj  C  TT  X^j  >  ,  it  is  sufficient 

to  prove  that  (k.2)  is  not  necessarily  sharp.  Since  w  =  *  1  ,  a  random 

X  J 

vector  Z  for  which  equality  is  attained  when  k=3  must  have  a  distribution 
of  the  far* 

?£tl,  1,  1)J  =  1,  1)}  =  P2  ,  p{+(1,  -1,  1)}  =  P3  , 

?{-(!,  1,  -1)J  *  ^  ,  ?((0,  0,  0)}  *  1-a2  . 
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r  lead  to  th<-  solution 
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Pj^  '  CT2(lr3p)A  ,  Pg  -•  Pj  »  Pjj  "  02Cl-p)A  • 

Z  Is  positive  definite  vhenever  -l/2  <  p  <  1  and  r.o  distribution 
attaining  equality  ir.  (4.2)  exists  when  -  l/2  <  P  <  -  1/3  -  jj 

o 

Theorem  4.3.  Let  k  >  2  and  Z  *•  <j  [(l-p)l  +  pe'e]  . 

Equality  can  be  attained  in  (4.3)  whenever  there  exists  a  Eadamard  matrix 
of  order  k  ;  otherwise,  equality  may  not  be  attainable. 

Remark.  Since  £  l}  **•  £Xi*2‘  —  ^  *  s*^n  *1  '*  *2}  »  M 

improvement  cf  (4.3;  for  k  -  2  is  given  by  (3.IO)  and  C3-l*»)  • 

Proof.  A  distribution  attaining  equality  in  (1* .3)  Is  given  by  (4.5)  •  We 

r.eed  only  show  that  w^  €  ('TT'x.  >  l)  .  The  first  row  cf  V  la 

J 

e  .  All  other  rows  of  W  must  have  an  equal  number  of  positive  and 
negative  entries  because  w^w^  .t  0  .  Because  k  is  a  multiple  of 
4  ,  this  means  that  w^'  has  an  ever,  number  of  negative  entries. 

Equality  carrot  be  attained  in  (4.3)  if  it  cannot  be  attained  in 
(4.2).  S 


-a f r»  ,->*  v*--  r3»»>?r**yi^*»v  ***  /  wi»#' 


k  ”-A<  «••• 


.•  rr.-r  fl  ftW!X^ri‘v I 


5-  rounds  vhfr,  only  variances  are  kr.cvn. 


rhf-cr< a  5-1-  If  7  -  (Xiy...,Xk)  is  a  random  vector  with  EXj  •---  , 


2  2 

vht  r>p  <y_  <  cr  9  J-li  2,  k  ,  then 


(5-1)  P  £nln  7 ,  >  1  or  min  (-X^)  >  1^  <  , 

J  4  > 

(5-2)  P  ^air.  X,  >  1 J  <  cTj2./ (l+a^2 )  , 

(5-3)  P  {:tt  y^*  >  i  and  all  Xj  are  of  the  same  slgrij  <  TV 9 * 

(-5A)  P  {jTT  xji  >  1  and  all  Xj  >  oj  <  TT  ^Vd^lT  <x/^)  » 

(5.5)  P  £nin  ^  >  l]  <  ax2  , 

J 

(5-6)  f  <tt«/a, 

(5-7)  P  {TTXji'i}  <Tr»//k  •  ••  ■  - 

Proof.  If  T  5  I*  C  ^  and  P  {x  e  T*J  <  p  ,  then  trivially 
P  {x  €  t}  <  p  .  Inequalities  (5-l)  and  (5-5)  follow  from  (l.l),  and  (5-2) 
fellows  from  (l.2)  in  this  manner.  Inequalities  (5-3)»  (5-*0»  (5-6)  and 
(5.7)  fellow  respectively  from  {3 .10),  (3-ll),  (**.2)  and  (b.3)  •  il 

Theorem  5-2.  Equality  in  (5-l)  -  (5-7)  can  be  attained. 

Proof.  Equality  in  each  cf  (5-l)  -  (5-7)  i»  achieved  by  one  of  the  following 
dist-ibutions  after  a  change  of  variable. 
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(i)  P  (y  .)  -  p  {y  =  -}  -  <r/2  ,  p  {y  o}  -  i-o-2  , " 

(ii)  P  fe.o}  /'a- a2)  ,  p  {z  --  -a2-}  -•-  1/(1' cr2)  # 

(111)  P  {U  -  v(i'j  a2/k  ,  J-l,  k  ,  P  {u  -  0}  -  1-a2  , 

s£«?-e  io  tlse  j**1  row  cf  (21  -  t  ’e):k  X  k  . 

Equality  ia  achieved  ir  (5-l)  aid  (5*5)  11‘  X^  -  (ffj/cr)Zj  *  lc 
0-2)  if  ^  *  (ff/Oj)  Yj  -. 

Defir*  cr2  -  TTa2k  ir  (i)  -  (ill)  -  Equality  is  achieved  in 

1  J 

0-3),  (5-6)  and  for  k  even  in  {5.7)  If  X^  -  (a^/ff)  Z^  ,  in  (5-^)  if 

E,  -  [a. fa)  Y<  ,  ir.  (5-7)  for  k  odd  if  X  -•  {a. fa)  U  .  }| 
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We  now  show  that  the  above  inequalities  are  sharp.  Inequalities  (6.1) 
and  (6.2)  art  the  only  inequalities  that  we  prove  sharp  without  showing 
that  equality  is  attainable.  (See  Section  2  for  a  clarification  of  this 


distinction.)  Indeed,  we  show  that  unless  at 


=  0  ,  equality 


cannot  be  attained  in  (6.1)  and  (6-2)  so  that  the  probabilities  of  these 
inequalities  are  strictly  less  than  the  given  bounds. 

Theorem  6.2.  Inequalities  (6.l),  (6-2)  and  [&. 3)  are  sharp-  Equality 
in  (6.1)  and  (6.2)  can  be  attained  only  if  -***=  =  0  .  Equality 

in  (6-3)  can  always  be  attained. 


Proof.  Case  of 


Choose 


€,  0  <  €  <  cr^  ,  and  let  6  * 


l/(k-l)  | 


ll-(l-e/o?)  j  .  Let  Z  =  (Z  )  be  a  random  vector  with 

x  x  » 


mutually  independent  components  r.uch  that 


?(ZjL  =  1)  =  P(ZX  *  -  1)  =  a2/2  ,  P^  =  0)  =  1  -  a\, 


P{Zj  =  tf  /5)  =  PfZ^  =  -  ay 8]  =  62/2  ,  P[Zj  =  0}  =  1  -  62  ,  J  =  2, . . .  ,k 


Setting  T  =  {min  (y  +...+y  )  >1  or  min'  [-(y1+*. -+y,)]  >  1)  , 
j  J  J  j  i  J 

we  have 


P{Z  e  T)  >  P{Z.  =  +  1}  TT  P(Z.  «  0) 

J=2  J 


which  proves  that  (6.1)  la  sharp. 
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To  attain  equality  In  .{6-1),  i-e.,  In 


'6.M 


P(X  e  T3  <  FfjXjj  >  1}  <  tr2  , 


It  sau3t  be  that  equality  la  attained  In  the  right  hand  Inequality.  By  (2.2), 


and  since  FZ^  -  0  , 


P{ZL  r  1}  -  F{Z1  -  -  1}  =  c?  ,  F{Z^  =  0}  =  1  -  a* 


2 

Suppose  that  1  is  the  smallest  index  (  i  >  1  )  fcr  which  >  0  .  Then 


PfZ 


;  -  0)  *  1  ,  J  -  2,...,i-l  ,  but  Z  must  assume  some  value  v  /  0  vith 

%J  i 


positive  probability.  If  v  >  0  and’ if  Z^  •  1  ,  »  v  ,  then 


(Z^,...,Z^)  i  T  because  Z^  £  1  and  -  (Zj----+  Z^)  1  .  But 

PfZ^  -  -  1  ,  2^  =  v]  •=•  ?[ZX  =  -  1?  r {Z^  -  v j  >  0  .  This  means  equality  is 
net  attained  at  the  left  hand  inc-ctality  of  (6A).  A  similar  argument  holds 
when  v  <  0  . 


Case  of  (6.2).  Choose  e  >  0  and  let  Z  be  a  random  vector  vith  mutually 
independent  components  such  that 


P{ZX  »  1)  *  (T^/  (l  +  a^)  »  FfZ^  ~  *  11  l/(l'+  cr^) 


PfZj  -  6)  -  ay  (62  +  a2),  ?( *  -  a2/5)  -  l/(62  +  02) 
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this  means  that  if  the  random  verier  Z  attains  equality,  PfZ^  *  +  1  or  0)  o  1  ,  ^  # 
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Clearly  this  Is  gn.ster  than  /(l  »  cr^)}  -  e  fcr  B  sufficiently 
small ,  so  that  (6.2)  is  sharp. 

The  argument  that  equality  cannot  be  attained  It.  (6.2)  is  essentially, 
the  same  a3  for  (5.1 ; .  In  this  case  a  random  vector  Z  attaining  equality 
requires  F(ZL  -  1]  =  CT2’  /(l  *  a2)  and  P(Z;L  =  -  a*\  -  l/(.l  +  c\)  ■ 

Case  of  (6-3).  Let  Z,  ,  J  --  1, . .  .,k  be  mutually  independent  random 

J 

variables  such  that 


-  "W  '• 


.•  • _ » _ 


F(Zj  =  +  S'3'1)  u  ffj.  /  22J‘1  ,  P{Zj  =  0)  »  1  -  a2  /  22J*2  ,  J  -  1,-..,V.  ,  .  j(  «  "  ^  - 


then  EZ  -  0  ,  EZ2  -  fcr  all  J  ,  and 
J  J  J 


Plain  jZ^.-.-f  Z  J  >  1)  ?{|Z1|  >  1)  -  tr2  . 

J 


Hence,  equality  is  attained  ir.  (6.3)  whenever  F(Y  --  Z)  =*  1  .  || 

By  (6.L),  sharpness  of  (6.1)  implies  sharpness  of  (6 - 3 ' »  hut  does ‘not 
imply  that  equality  can  be  attained  In  (6.3)  a3  we  have  just  proved. 

One  can  strengthen  the  hypotheses  cf  Lai's  inequality  [5,  p.  229] 
(which  provides  a  sharp  upper  bound  for  P(  |X.  |  >  1  or  jx  j  .>  1} 


•.•.'I'.*. w 
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in  terms  cl  covariances)  tc  obtain  a  bound  for  >  1  cr  ;Y^  *  >  1}  , 

where  Y^  and  Y^  are  independent.  It  is  curious  to  rote  that  while  this 
specialization  is  a  parallel  to  those  of  Theorem  6-1,  it  Is  not  sharp  since 
Xolmogo rev's  inequality  provides  a  better  bound. 


7-  Scr.e  Extensions. 

There  are  a  number  of  methods  by  which  tit  results  can  be  extended. 
Wt  mention  only  a  few  and  give  sene  partial  results. 

7  1.  Extensions  to  Stochastic  Processes.  If  { X ^  ,  t  €  T)  Is  a  real 

1-1  t 

Stochastic  process  with  Ejx^)  -  0  for  all  t  e  T  ,  then 


F{  ir=f  lx  i  >1]  <  inf  E{>^)  =  p  , 
t  €  T  1  t  €  T  • 


F{  ir.f  X  >  1  or  sup  X  <  -  1]  <  p  , 
t  e  T  1  tel 


Ft  inf  X  >  1}  <  p/(l  +  p)  , 
t  c  T  z  ~ 


whenever  the  probabilities  are  defined.  These  inequalities  are  trivial 
consequences  of  (l.l)  and  (1.2)  since 


(  inf  X  >  1  or  sup  X„  <  -  1}  C  {  icf  |x.|  >  i;  <T  {|X«;  >  l)  , 
t£l  1  t  €  T  "  t  €  T  V  " 


{  inf  X,  >  1)  C  (X  >  1} 

tel 


f  or  all  s  c  T 
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I a  ~ew  cf  Theoreir  3--*  we  can  hope  scaetines  to  improve  (7*2)  ar.d 
i7-3r  if  the  coanacce  function.  of  the  process  is  known-  General  results 
Hrv  net  <  asiiy  obtainea.  «k-  content'  ourselves  with  a  single  example  lor 
which.  (7-2)  and  (7-3)  car.  be  isprovea  and  concentrate  cn  showing  that  no 
inpraveaest  Is  possible  if  the  process  is  a  martingale. 

Heci-er  7.1.  If  T  is  net  finite  and  t  €  T)  is  a  process 

with  SI  =  0  and  S  X2  =  o2  ,  £  X  X  =  a2p  ,  (s  j?  t)  ,  for  all  s,t  £  T  , 

X>  3  Si 

(where  *j  p  <  1}  ,  then 

(?-M  P[  lEf  X  >  1  or  sup  X,  <  -  1)  <  a2P  , 

tef  l“  t  €  T  *  ~ 

{7.5}  P(  '  isf  X  >  1}  <  a2p/(l  +  a2p)  , 

t  £  7  . 

whenever  the  prorabilities  are  defined.  • 

Proof-  This  follows  fror  Example  2  of  Section  3 -1* 

Theorem  7-2.  If  (X^,  t  e  [0,t]}  is  a  sartlngale  with  E  =  0 
ana  E  X2  =  cr2(t)  ,  then 

(7-6)  Pr  inf  X  >  1  or  sup  X  <  -  1)  <  ff2(0)  , 

t  €  [0,t]  t  €  [0,t]  ~ 

(7-7)  P(  i=f  X  >  1)  <  a2(0)/[l  +  a2(0)]  , 

t  €  IO/rj 


wherever  the  probabilities  are  defined. 
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Equality  is  attainable  in  both  of  these  inequalities  If  a  (*)  is 
right  continuous. 


Remark.  Inequalities  (7-6)  and  (7-7)  remain  true  if  ve  replace  the  condition 

that  the  process  Is  a  martingale  by  the  condition  that  the  process  has 
2  2 

covariance  E  X  X  -=  a  (s)  ,  s  <  t  (of  course,  a  (‘)  must  be  non-decreasing). 

S  v  ”• 

This  is  the  case,  e.g.,  if  the  process  has  orthcgcnal  increaents,  and  with 
this  replacement  the  theorem  would  generalize  Example  5  of  Section  3-2.  We 
have- net  chosen  to  weaken  the  conditions  of  the  theorem  because  to  do  so 
would  weaken  the  result  that  equality. is  attainable. 

Proof.  (7-6)  and  (7-7)  are  immediate  consequences  of  (7-2)  and  (7-3).  We 
now  define  a  martingale  attaining  equality  in  (7-6).  Let 


0  ,  Q  <0  , 

•<p(9)  *  <  /(O)  +  S-M  r..a  ,  0  <  9  <  t  , 


.#  , 
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where  3 


'a2V 0  -  g2(0) 


9  >  T  , 


,  and  1st  p  be  the  measure  induced  cn  the 


/  1  -  a2(0)  '  . . . 

Borel  subsets  l$w  of  [0,tj  by  the  right  continuous  distribution  function 
<p  .  Let  Q  -  {D,t]  x  {-1,1}  ,  and  let  (8  be  the  3orel  subsets  cf  Q  .. 

Define  a  probability  measure  P  on  6  by  ?(=)  =  p(B*)/2  for  3  -  3*  x  (l) 
or  B  =  B*  x  f-1)  and  B*  e  &  .  Denote  a  point  in  fl  by  (r,&)  and  let 
{Z^,  t  €  [0,t])  be  the  process  defined  on  the  probability  space  (fl,  0,P)  by 
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It  is  easily  verified  that  the  process  {Y  ,  t  €  [0,tj)  is  a  martingale 

x» 


satis.fyir.g  the  conditions  oi  the  theorem  and  attaining  equality  in  (7-7)-  ]1 


7-2.  Extensions  Through  Transformations.  Let  X  be  a  random  variable 
with  EX  -  0  ,  EX2  ^  a2  .  By  means  of  the  linear  transformation 
y  =  TX  f  u,  1J  >  0  ,  one  can  obtain  Chebyshev’s  inequality  in  its  usual 
generality  from  (l.l)  with  e  =  1  . 

Multivariate  Chebyshev-type  inequalities  with  hypotheses  concerning 
means  and  covariances  can  be  extended  similarly  by  linear  transformations, 
and,  in  fact,  the  possibilities  are  much  greater  than  in  the  univariate  case. 

Let  X  be  a  rar.  im  vector  with  FX.  =  0  ,  EX'X  =  £  ,  and  suppose  that 
one  has  the  inequality 


(7-9) 


P{X  e  T}  <  p(£) 


.-1 


If  H  Is  a  non-singular  matrix,  then  using  the  transformation  y--x5  ♦  n 

one  obtains 


(7-10) 


P(Y  eS]<  p  (H'  Tf  H)  , 


'.ion-linear  transformations  may  also  be  useful,  e.g.,  with  =  X2  , 


.1  •*  1,  ...,k  ,  the  results  of  Section  5  yield  corresponding  results  for 
positive  random  variables  in  terms  of  their  expectations. 
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whenever  Y  is  a  random  vector  with  EY  =  u  ,  EY'Y  =  TTand  S  *=  fy:  (y-p)H  €  T)  . 
Clearly,  (7.10)  is  sharp  whenever  (7-9)  is  sharp. 
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7-3*  Bounds  for  Subsets.  It  is- immediate  that  if  and  (i) 

P(T^)  <p  ,  then  (ii)  P(Tg)  <  p  -  Obviously,  if  (ii)  i3  sharp,  theft 

(i)  is  sharp,  and  it  is  perhaps  surprising  that  in  many  cases  (ii)  iS 

sharp.  Examples  of  this  are  (U.l),  (5*l),  and  (5*2). 

As  a  further  application,  let  us  consider  inequality  (3-8)#  but 

suppose  that  some  entries  of  the  covariance  matrix  E  are  unknown.  ?il£ft 

we  can  consider  subvectors  (X.  ,  ...,X  )  of  (X  X^)  for  which 

*1  n 

corresponding  covarianc..  matrix  is  known  and  apply  (3-8),  together  wii'h 

P{  min  X  >  1)  >  Pf  min  X.  >  l)  . 

1  <  J  <  n  \j  “  “  1  <  J  <  k  J 

Whether  this  procedure  (which  can. also  be  applied  to  (3-7))  leads  tt) 
sharp  inequalities  is  not  known,  but  in  Section  5  wc  proved  sharpnes's 
vhen  only  the  diagonal  elements  of  E  are  known.  This  procedure  can  bP 
used  whenever  at  least  one  diagonal  element  of  E  is  known. 

8.  A  •krovledgement .  The  authors  are  indeed  grateful  to  Herman  Cricrfto(f 
for  suggesting  the  proof  of  Lemma  3.3,  art  for  several  valuable  comment 8 
and  discussions. 
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